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Sequence of Events Leading to 

EAGAR 



In Spring 2013, high level NASA and Boeing management were 
seeking opportunities to collaborate on a flight test activity 
involving the ecoDemonstrator. 


The Airspace Systems Program Office identified FIM as a viable 
candidate. 


ATD-1 accepted the challenge. 


Work began in July for a December 2013 flight test. 


Objectives 



Conduct a rapid collaborative development effort with Boeing to 
equip the 2013 ecoDemonstrator test aircraft (B787-800) with an 
ASTAR-based airborne spacing tool. 


Conduct a flight test to demonstrate precision spacing between 
two aircraft with the aid of NASA's ASTAR algorithm. 



Minimum Success Criteria 


ATD-l: Successful rapid collaboration between NASA and Boeing 

FIM operation: Both Target and FIM aircraft fly from initial 
waypoint to FAF without interruption (vectors, etc). 

Was it feasible in the real world? 

FIM software: Continuous progression to achieve assigned 
spacing goal behind Target aircraft. 

Was the software robust and perform as expected? 


"Stretch" Success Criteria 


Demonstrate consistent final spacing within +/-5 seconds at the 
FIM termination point. 


Run # 

Delivery Accuracy 

1 

-7.5 

2 

1.5 

3 

1.4 

4 

2 

5 

-3.5 

Std. Dev. 

4.16 

Range 

9.5 


Flight Test Approach 



Equip the ecoDemostrator with the ASTAR-based application 
hosted on a laptop PC 


Conduct an arrival sequence and connect to a published approach 
procedure into a dedicated test airport 

Target and Ownship aircraft fly on the same route from TOD to 
runway: 

• Start 100-120 miles from runway; line up with ATC help 

• Arrival procedure is typed into the FMS, approach is loaded, then full route 
connected together 

• Locate target, enter clearance, and initiate test 



The Plan / The Reality 



Lab Testing for software integration / Occurred at four locations 


Ground Testing aboard the airplane to ensure laptop is receiving 
required data / ~7 hours over two days 

4 meetings with Air Traffic Control supported by Boeing Flight Test 
Analysis and Flight Test Operations / Many more, but mostly 
without Analysis or Ops 

2 hours of concurrent testing to monitor the system in flight / 8 
hours in the air, no NASA personnel taking part 

6 hours of dedicated flight time over 2 days, ~6 runs / ~6 hours, 1 
day, 5 runs 
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Schedule Milestones 


Intro ASRB briefing: 

Simulation Requirements Review: 

Initial Software build delivered to Boeing: 
Laptop with ASTAR available for ground testing: 
1 st Dry Run in NASA sim: 

Boeing Bench Testing 
ASRB briefing: 

Boeing Aircraft Ground Testing 
Function-Complete Code Freeze: 

Bug-Fix Code Freeze: 

Final Software build delivered to Boeing: 
Concurrent Flight Testing: 

Flight Demonstration: 



November 7, 2013 
April 30, 2014 
June 11, 2014 
June 25, 2014 
June 26, 2014 
July-September 2014 
August 14, 2014 
November 10-11, 2014 
December 5, 2014 
December 5, 2014 
December 6, 2014 
December 6, 2014 
December 12, 2014 


Participants 



NASA 


• Laptop Operator 

• Developers supporting flight 

• Ground observers within FAA ATC facilities 

Boeing 

• Developer and Flight Test Engineers supporting the flight 

• Test Pilots (2 B787 & 1 T-38) 

FAA 

• Seattle Center and Grant County Approach Air Traffic Controllers 
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Target Aircraft Search 





Alaska Airlines B737NG 


ASTOR Simulated Model 


FAA Global Express 5000 




/ 


T-33 


T-38 









Airport Search 


It took several months to settle on an airport 

• Seattle, WA - KSEA 

• Phoenix, AZ-KPHX 

• Moses Lakes, WA- KMWH 

• Denver, CO - KDEN 

• Glasgow, MT- KG GW 


Avionics Architecture Overview 



Diagnostic Tool Screenshot 
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and Spacing Technologies 



Flight Deck-based Interval Management 


ASTAR Ver. 12 

Build: EAGAR 14 5 2014DEC05R-PARTS.exe 


Navigation Database Cycle 201412 
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Demo Arrival Location 
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Full Route Structure 
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Concurrent Testing Route Structure 



^Kelowna 


Vancouver 


S\bbotsford 


+ ONSET 


. 'kruz§ 

GLASR 

GLASR SWAUK;;^ 


JAKSN 

GI^PVjjvQODI FLAAK 


Spol^an'e 


.HETHR 


NEpTZf 


AUBRN 

P AD I IUMPP 
fcSQNDR 


FOURTd 

BRE^t 


RADDY 


CHttNS CHJ1 


;riEg. 


Med sal 


?tera 


<Bbrtland 



Test location dependent on 
weather 


Development team built routes to 
cover all areas 


Location was decided the morning 
of test (over ocean) 


Olympia Arrival built, tested, and 
e-mailed up while still flying 
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First FIM 










Dec. 6 Concurrent Testing 





Dec. 6 Concurrent Testing 



Ownship speeds and time-error 
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Flight Demonstration Materials 


Flightiest Plan and Communication Protocol packet 
Boeing Flight test plan 
Controller Briefing Packet 
Pilot Flight Test Cards 

Briefing packet for ground observers at FAA ATC facilities 


Test Setup 

VHF radio frequency required to enable communication between 
the airplane and chase 

Flight Interphone jacks and headsets at participant locations on 
B787 

Ethernet connections from the cockpit to the ASTAR laptop 
115 volt/60 Hz power available at all workstations 
All laptops adhered to workstations with Velcro 
All participants properly briefed 


Test Requirements 



Contiguous US - flight testing 

Daylight only, VMC 

See and Avoid - 14CFR 91.113(b) 

Sparsely populated area or over water only 

Coordinate with applicable ARTCC in advance. Stay under ATC 
control, or pre-coordinated agreements. 

Below FL180, local altimeter setting used by both aircraft 



Test Sequence 



• Depart KBFI and fly test profile into KMWH to the FAF 


Run # 

Initial Speed 

Initial Altitude 

Arrival T-38 

Arrival B787 

In-Trail Distance 

1 

280 

FL220 

SUBDY 

SUBDY 

13 nm 

2 

280 

FL220 

KNOCK 

KNOCK 

16 nm 

S 

280 

FL220 

SUBDY 

SUBDY 

10 nm 

4 

280 

FL220 

SUBDY 

KNOCK 

Initial fixes at same 
time (7.5 nm) 

5 

280 

FL220 

SUBDY 

KNOCK 


Schedule: Run 1 / T-38 refuel / Run 2-4 / T-38 refuel / Run 5 


• Upon conclusion of demonstration, return to KBFI. 
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Dec. 12 Winds Aloft 



Input winds : A selection of altitudes was requested by cockpit, the 
best altitudes available for input follow. 


FL230 

190 degrees / 64 knots 

FL210 

193 degrees / 54 knots 

FL180 

190 degrees / 40 knots 

16,000 

260 degrees / 19 knots 


Input Speeds to ASTAR 


Run 

Cruise Speeds 

Descent Speeds 

1 

0.65 Mach / 280 knots 

0.62 Mach / 270 knots 

2 

0.76 Mach / 340 knots 

0.62 Mach / 270 knots 

3 

0.64 Mach 

0.62 Mach / 280 knots 

4 

0.65 Mach / 300 knots 

0.62 Mach / 280 knots 

5 

0.65 Mach 

0.62 Mach / 280 knots 
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Weather at Grant County Airport 



Initial METAR at KMWH 7000' OVC 


ATIS for KMWH (During Run 2): Calm, 10 miles visibility, 8500 OVC, 
Temp 6, Dewpoint 4, Altimeter 29.73. 


Icing at 10,000 ft. 


AIRMET in the vicinity with wind shear 


^ RUN ll Delivery Accuracy -7.5 sec. early 


Both aircraft on SUBDY Arrival 

13 nm separation planned (12.5 nm actual) 

120 seconds planned (112.5 @ FAF) 



FIM Distance: 94.5 nm 
FIM Time: 20 min 11 sec 


BOE4 B/88 

168 774 ■= 

KBin KMWH I I.S4AM 


Performed go-around at 11:54:55 


bof ?8t 
« 3^ joi 



Run 1 



3 speed inversions 

13 speed commands (1 command/1 min. 33 sec) 

B787 performed a go-around b/c T-38 was on runway 



Grant County International 
Airport, Moses Lakes, WA 



Run 1: Joining SUBDY Arrival 
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Run 1: Turn at UPBOB 
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Run 1: Turn to Final 
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Run 1 Final 






Mosesilrake 
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Run 2: Delivery Accuracy +1.5 sec. late 


• Both aircraft on KNOCK Arrival 




• 16 nm separation planned (24.12 nm actual) 

• 120 seconds planned, 150 sec. actual (151.5 @ FAF) 


FIM Distance: 
89.9 nm 


FIM Time: 

17 min 54 sec 
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Run 2 



• 3 speed inversions 

• 14 speed commands (1 command / 1 min. 17 sec.) 


Ownship departs ahead of 
T-38 and holds, but gets 
disoriented for the initial 
setup. T-38 performs a 
teardrop entry. 

Causes ownship to get 
behind schedule, maintains 
340 kts. airspeed to try to 
make up the distance. 



i ewe la h 


Valley 


Tumtum 


Wellpinit 


. \V- Ownship 


Nine Mile Falls 


Country Home 








Poor setup prior to run 

• ASTAR on ~8 min. with no pairing 

• OWNSHIP OFF PATH message 

• Cockpit stated B787 was on path 

• Paired 8 sec. prior to shutdown 

• 6.14 nm separation at shutdown 


3 



40 



Run 3A: Delivery Accuracy +1.4 sec. late 



• Both aircraft on SUBDY Arrival 

• 10 nm separation planned (6.23 nm actual) 

• 120 seconds planned, 

(121.4 sec @ FAF) 

FIM Distance: 43.78 nm 
FIM Time: 10 min 48 sec 
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Run 3A 
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Run 3A 



• 1 speed inversion 

• 7 speed commands (1 command / 1 min. 17 sec.) 

• Forecast winds were not entered on this run due to time 


constraints 



BOlPiS 
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Run 4: Delivery Accuracy +2.0 sec. late 




T-38 Target on SUBDY Arrival, B787 Ownship on KNOCK Arrival 
7.5 nm separation planned with concurrent arrival at lAFs 
Poor initial setup 
1.63 nm along route separation 
120 seconds planned 
(122 @ FAF) 


FIM Distance: 71.59 nm 
FIM Time: 17 min 40 sec 
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Run 4 
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Run 4 
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Run 4 
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Run 4 







• 4 speed inversions 

• 13 speed commands (1 command / 1 min. 26 sec.) 
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Run 5: Delivery Accuracy -3.5 sec. early 



• T-38 Target on SUBDY Arrival, B787 Ownship on KNOCK Arrival 

• 7.5 nm separation planned with concurrent arrival at lAFs 

• 10.83 nm along route separation 

• 120 seconds planned 
(116.5 @FAF) 

FIM Distance: 85.88 nm 
FIM Time: 18 min 33 sec 




Run 5 
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Run 5 
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Run 5 



3 speed inversions 

14 speed commands (1 command / 1 min. 20 sec.) 


Altitude and Distance 




Run # 

Initial 

Speed 

Initial 

Altitude 

T-38 @ 
FIM 
Start 

B787 @ 
FIM 
Start 

Planned 

In-Trail 

Distance 

Actual In-Trail 
Distance 

1 

280 

FL220 

21875 

22998 

13 nm 

12.51 nm 

2 

280 

FL220 

16625 

22388 

16 nm 

24.12 

3 

280 

FL220 

11425 

12908 

10 nm 

6.23 

4 

280 

FL220 

19050 

22739 

7.5 nm 

1.63 

5 

280 

FL220 

20825 

22313 

7.5 nm 

10.83 
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FIM Distance 


• Objective was to get between 80-100 nm of data 



Run # 

FIM Distance 

1 

94.5 

2 

89.9 

3 

43.8 

4 

71.6 

5 

85.9 

Average 

77.14 
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Spacing Error (sec) Groundspeed Deviation (kt) Groundspeed (kt) Airpeed (kt) 



Run 1 



Run 1: NASAOOI Following BOE38T 
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Spacing Error (sec) Groundspeed Deviation (kt) Groundspeed (kt) Airpeed (kt) 


Run 2 


Run 2: NASAOOI Following BOE38T 


- ProfileCAS 

- CmdCAS 
■ CmdEnd 




100 80 60 40 

FIM Aircraft DTG (nmi) 


500 

400 

300 

200 

100 




140 120 


100 80 60 40 

FIM Aircraft DTG (nmi) 







Spacing Error (sec) Groundspeed Deviation (kt) Groundspeed (kt) Airpeed (kt) 


Run 3A 
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Spacing Error (sec) Groundspeed Deviation (kt) Groundspeed (kt) Airpeed (kt) 



Run 4 



Run 4: NASAOOI Following BOE38T 
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Spacing Error (sec) Groundspeed Deviation (kt) Groundspeed (kt) Airpeed (kt) 



Run 5 



Run 5: NASAOOI Following BOE38T 
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Altitude (ft* 1 000) Altitude (ft*1 000) 



Altitude 
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Groundspeed 1 
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Groundspeed 2 
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Groundspeed 3 
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Groundspeed 4 
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Groundspeed 5 
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Groundspeed Deviation 1 



Airspeed 1 



Run 1 
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Spacing Error 1 
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Groundspeed Deviation 2 


Run 2 
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Spacing Error 2 
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Groundspeed Deviation 3 




Vertical Track Error 3 


■ 
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Airspeed 3 
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Spacing Error 3 
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Groundspeed Deviation 4 


Run 4 
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Run 4 

ADS-B / 
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Spacing Error 4 
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Groundspeed Deviation 5 


Run 5 
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Spacing Error 5 
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' 7 * Vertical Track Error 1 



"Cleared SUBDY descent down to 5000 
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Vertical Track Error 2 




Vertical Track Error 4 


■ 
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Vertical Track Error 5 


■ 
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Horizontal Track Error 1 
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Horizontal Track Error 3 



Horizontal Track Error 4 
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Test Issues 



• ADS-B was experimental and circuit breaker had to be reset just 
prior to testing (day of concurrent testing) 


• Floating point issue with the Rockwell ISS unit 

• Cmd speeds on inbound track sometimes below landing 
airspeed limitation for B787 (155 CMD v. 165 Stall for config.) 

• T-38 fuel limited: Shortcut the route and time he had available to 
fly - affected aircraft positioning and decision making 

• T-38 was vertically challenged to dodge icing and stay within the 
algorithm performance 

• Winds aloft were not given until in the air. 

• In-trail distances ranged 22.6 nm instead of 8.5 nm (We went 
almost three times the planned in-trail distance range - FIM can 
handle slop.) 


Test Issues 



• Substitute pilots the day of the demonstration. 


• Pilots have no reference to perform FIM, no training- compare 
to simulation testing in RAPTOR/CA 5.3. 

• T-38 performed teardrop entries, B787 didn't 

• T-38 was GPS limited: Entered MWH, not KMWH to prevent flight 
plan termination. No time/ability to re-input everything. 

• ATC re-input new flight plans after every run - High workload. 

• Other conversations on a single party line meant waiting to issue 
speed commands, sometimes 20-30 seconds. 

• B787 overly aggressive with the speed brakes on initial run, then 
under aggressive on subsequent runs. 

• Simulation studies designed the simulated aircraft to fly route to 
the runway. Unintended consequence: No summary log if the 
aircraft doesn't land. 



Safety Issues 



• Fuel leak in one of the wings, while being fixed a second leak was 
discovered. Boeing suggested they would fly off the gas in the 
other wing and central tank, (not discussed in prebrief) 


• Icing along route using an aircraft not equipped with deice 

• 1 out of 2 radios lost at startup on T-38 - Pilot could either 
communicate with ATC or the B787, but not both. He decided if 
he declared it, the test would get cancelled. 

• Resulted in ATC confusion, because T-38 was communicating 
when not expected. (B787 was communications leader) 

• B787 was eager to get to same frequency with T-38 because it 
was the only way either could know what the other a/c was 
doing (or else T-38 had to leave ATC frequency) 
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Lessons Learned 



• Key logging for the Flight Test Gateway output (when we check to 
see where aircraft are located in reference to us) 


-Allows for a point of reference 

• Streamline route building, testing, and packaging 

• Realtime .kmz graphics on Google Earth 

• Color coordination on the .kmz files to recognize 
On/Activate/Execute periods graphically 

• Large database for queries to pull in different data sets 

• Training - Better pilot understanding of FIM and test setup. If one 
does teardrop, then "follow the leader". 

• Summary logs without Weight-on-Wheels 


Lessons Learned 







CSC8580 


IN786CS- 


P$E>Z-R352 


ETDW1 


S'SOWWi 


NCA109 ^ 



We have all the ADS-B 
data for other aircraft 
while we flew. 


We can build new 
custom routes that 
allow us to FIM 
behind them in 
simulation and further 
verify our software 
and algorithm. 
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Lessons Learned 


ASTAR In/Out data 

ERAM displays from Seattle Center 

Boeing providing flight deck display videos and timestamp 

Analysis meeting scheduled Friday, Jan. 30, 2015 to discuss 
gathered data 





